Skip to main content
Version: 3.0.0

Meshing

Introduction​

Meshing is a crucial feature in AR applications that allows for the creation of 3D meshes of the real-world environment. These meshes enable more advanced interactions and realistic placement of virtual objects. Using Unity's XR Interaction Toolkit and AR Foundation, developers can implement meshing to enhance their AR experiences.

Capabilities​

Depth mesh expands many AR capabilities.

  • Visualization: Provide visual feedback as users scan their environment.

  • Occlusion: Effectively hides virtual objects behind real ones, particularly useful indoors.

  • Physics: With the help of MeshColliders, virtual objects and characters can interact more realistically with the environment and real objects.

  • Flexible Object Placement: Allows for more flexible addition and arrangement of virtual objects compared to plane detection.

  • Semantics: Employs advanced capabilities to identify and categorize mesh blocks into specific classes, including BACKGROUND, WALL, BUILDING, FLOOR, CEILING, HIGHWAY, SIDEWALK, GRASS, DOOR, and TABLE. This enhances the overall context awareness of augmented reality experiences.

Requirements​

To implement meshing, ensure you have the following setup:

  • Unity Editor: Version 2021.3 or later.
  • Packages:
    • XR Interaction Toolkit
    • AR Foundation
    • AR Subsystems

Developer Guide​

1. Basic Setup​

  1. Create a new project in Unity.

Need help setting up? Try Getting Started with XREAL SDK first.

  1. Install AR Foundation and AR Subsystems from the Unity Registry in the Package Manager.

image-20240529200949957

  1. Install XR Interaction Toolkit from the Unity Registry in the Package Manager and import Starter Assets in Samples tab.

    image-20240531111307809

  2. Create a new scene

  3. Add an XR Origin(XR Rig) GameObject to the scene:

    In the Project window, find Assets/Samples/XR Interaction Toolkit/3.0.1/Starter Assets/Prefabs/XR Origin (XR Rig).prefab, and drag it to Hierarchy window. This will add the necessary components for AR interactions.

    image-20240531111129519

  4. Add an AR Session GameObject to the scene: in the Hierarchy window, right-click and select XR > AR Session. This will add an AR Session component necessary for managing the AR lifecycle.

  5. Go to Edit > Project Settings > XR Plug-in Management, enable the XREAL XR plug-in.

2. Set Up Meshing​

Configure Meshing​

  1. Select the XR Origin(XR Rig) in the Hierarchy window.

  2. Click Add Component in the Inspector window.

  3. Search for and add the AR Mesh Manager component.

  4. In the AR Mesh Manager component, you can set the Mesh Prefab to a custom prefab for visualizing the generated mesh.

  5. For a quick test, you can create a simple prefab with a Mesh Renderer and Mesh Filter to visualize the mesh.

    image-20240710155954416

3. Testing Meshing​

  1. Connect your compatible device.
  2. Switch the build target to Android (File > Build Settings).
  3. Build and run the project on your device.

You should now see the generated mesh visualized in your AR application. You can use this mesh to place virtual objects or interact with the real-world environment.

Conclusion​

This guide covers the basics of setting up meshing using the XR Interaction Toolkit and AR Foundation. By following these steps, you can create immersive and interactive AR experiences that utilize real-world 3D meshes.